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,__! Abstract 

o 

This paper develops a mathematical theory of super-resolution. Broadly speaking, super- 
*. resolution is the problem of recovering the fine details of an object — the high end of its spectrum — 

from coarse scale information only — from samples at the low end of the spectrum. Suppose we 
have many point sources at unknown locations in [0, 1] and with unknown complex- valued am- 
plitudes. We only observe Fourier samples of this object up until a frequency cut-off f c . We 
show that one can super-resolve these point sources with infinite precision — i.e. recover the 
exact locations and amplitudes — by solving a simple convex optimization problem, which can 
essentially be reformulated as a semidefinite program. This holds provided that the distance 
between sources is at least 2// c . This result extends to higher dimensions and other models. In 
one dimension for instance, it is possible to recover a piecewise smooth function by resolving the 
discontinuity points with infinite precision as well. We also show that the theory and methods 
are robust to noise. In particular, in the discrete setting we develop some theoretical results 
explaining how the accuracy of the super-resolved signal is expected to degrade when both the 
noise level and the super-resolution factor vary. 



O 



> 



Keywords. Diffraction limit, deconvolution, stable signal recovery, sparsity, sparse spike trains, 
iyv l\ minimization, dual certificates, interpolation, super-resolution, semidefinite programming.. 

o 

(N 1 Introduction 



1.1 Super-resolution 
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Super-resolution is a word used in different contexts mainly to design techniques for enhancing the 
resolution of a sensing system. Interest in such techniques comes from the fact that there usually 
is a physical limit on the highest possible resolution a sensing system can achieve. To be concrete, 
the spatial resolution of an imaging device may be measured by how closely lines can be resolved. 
For an optical system, it is well known that resolution is fundamentally limited by diffraction. In 
microscopy, this is called the Abbe diffraction limit and is a fundamental obstacle to observing 
sub- wavelength structures. This is the reason why resolving sub- wavelength features is a crucial 
challenge in fields such as astronomy 32 , medical imaging (221, and microscopy 28 . In electronic 



imaging, limitations stem from the lens and the size of the sensors, e. g. pixel size. Here, there is an 
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inflexible limit to the effective resolution of a whole system due to photon shot noise which degrades 
image quality when pixels are made smaller. Some other fields where it is desirable to extrapolate 



fine scale details from low-resolution data — or resolve sub-pixel details — include spectroscopy 23 
radar [29] , non-optical medical imaging [25] and geophysics [26] . For a survey of super-resolution 
techniques in imaging, see |30| and the references therein. 



This paper is about super-resolution, which loosely speaking is the process whereby the fine scale 
structure of an object is retrieved from coarse scale information onlyjj A useful mathematical model 
may be of the following form: start with an object x(t\,t2) of interest, a function of two spatial 
variables, and the point-spread function h{t\,t<2) of an optical instrument. This instrument acts as 
a filter in the sense that we may observe samples from the convolution product 

y(tx,t 2 ) = (x*h)(t 1 ,t 2 ). 

In the frequency domain, this equation becomes 

y(wi,w 2 ) = x(uJi,W2)h(uJi,uJ2), (1.1) 

where x is the Fourier transform of x, and h is the modulation transfer function or simply transfer 
function of the instrument. Now, common optical instruments act as low-pass filters in the sense 
that their transfer function h vanishes for all values of uj obeying \uj\ > Q in which 0, is a frequency 
cut-off; that is, 

,2 I , ,2 



\oj\ := J u){ + lo\ > =>• h(ui,U2) = 0. 

In microscopy with coherent illumination, the bandwidth $7 is given by O = 2-7rNA/A where NA is 
the numerical aperture and A is the wavelength of the illumination light. For reference, the transfer 
function in this case is simply the indicator function of a disk and the point-spread function has 
spherical symmetry and a radial profile proportional to the ratio between the Bessel function of the 
first order and the radius. In microscopy with incoherent light, the transfer function is the Airy 
function and is proportional to the square of the coherent point-spread function. Regardless, the 
frequency cut-off induces a physical resolution limit which is roughly inversely proportional to £1 
(in microscopy, the Rayleigh resolution distance is defined to be 0.61 x 2tt/Q). 

The daunting and ill-posed super-resolution problem then consists in recovering the fine-scale or, 
equivalently, the high-frequency features of x even though they have been killed by the measure- 
ment process. This is schematically represented in Figure [TJ which shows a highly resolved signal 
together with a low-resolution of the same signal obtained by convolution with a point-spread 
function. Super-resolution aims at recovering the fine scale structure on the left from coarse scale 
features on the right. Viewed in the frequency domain, super-resolution is of course the problem 
of extrapolating the high-end and missing part of the spectrum from the low-end part, as seen 
in Figure [21 For reference, this is very different from a typical compressed sensing problem [6] in 
which we wish to interpolate — and not extrapolate — the spectrum. 

This paper develops a mathematical theory of super-resolution, which is not developed at all de- 



spite the abundance of empirical work in this area, see Section 1.8 for some references. Our theory 



takes multiple forms but a simple and appealing incarnation is as follows. Suppose we wish to 

1 We discuss here computational super-resolution methods as opposed to instrumental techniques such as interfer- 
ometry. 
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Figure 1: Schematic illustration of the super-resolution problem in the spatial domain, (a) 
Highly resolved signal, (b) Low-pass version of signal in (a). Super-resolution is about recov- 
ering the signal in (a) by deconvolving the data in (b). 
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(b) 



Figure 2: Schematic illustration of the super-resolution problem in the frequency domain, (a) 
Real part of the Fourier transform in Figure 1(a) (b) In red, portion of the observed spectrum. 



Super-resolution is about extrapolating the red fragment to recover the whole curve. 



super-resolve a spike-train signal as in Figure [TJ namely, a superposition of pointwise events. Our 
main result is that we can recover such a signal exactly from low-frequency samples by tractable 
convex optimization in which one simply minimizes the continuous analog to the l\ norm for dis- 
crete signals subject to data constraints. This holds as long as the spacing between the spikes is 
on the order of the resolution limit. Furthermore, the theory shows that this procedure is robust 
in the sense that it degrades smoothly when the measurements are contaminated with noise. In 
fact, we shall quantify quite precisely the error one can expect as a function of the size of the input 
noise and of the resolution one wishes to achieve. 



1.2 Models and methods 

For concreteness, consider a continuous-time model in which the signal of interest is a weighted 
superposition of spikes 

* = E a A> ( L2 ) 
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where {tj} are locations in [0, 1] and 5 T is a Dirac measure at r. The amplitudes a,j may be complex 
valued. Expressed differently, the signal x is an atomic measure on the unit interval putting complex 
mass at time points t%, t2, £3 and so on. The information we have available about x is a sample of 
the lower end of its spectrum in the form of the lowest 2f c + 1 Fourier series coefficients (/ c is an 
integer) : 

y (k) = [ e- i2 * kt x(dt) =Va,e- fl ^, k G Z, \k\ < f c . (1.3) 

Jo j 

For simplicity, we shall use matrix notations to relate the data y and the object x and will write 



( 1.3 ) as y = F n x where T n is the linear map collecting the lowest n = 2f c + 1 frequency coefficients. 
It is important to bear in mind that we have chosen this model mainly for ease of exposition. Our 
techniques can be adapted to settings where the measurements are modeled differently, e. g. by 
sampling the convolution of the signal with different low-pass kernels. The important element is 
that just as before, the frequency cut-off induces a resolution limit inversely proportional to / c ; 
below we set A c = l// c for convenience. 

To recover x from low-pass data we shall find, among all measures fitting the observations, that with 
lowest total variation. The total variation of a complex measure (see Section [A] in the Appendix for 
a rigorous definition) can be interpreted as being the continuous analog to the t\ norm for discrete 



signals. In fact, with x as in (1.2), ||:e||tv ^ s e 1 ua l to the t\ norm of the amplitudes | |<a| 1 1 = ^ 
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Hence, we propose solving the convex program 

min||x|| TV subject to J 7 n x = y, (1-4) 



X 



where the minimization is carried out over the set of all finite complex measures x supported on 
[0, 1]. Our first result shows that if the spikes or atoms are sufficiently separated, at least 2 A c apart, 
the solution to this convex program is exact. 

Definition 1.1 (Minimum separation) LetT be the circle obtained by identifying the endpoints 
on [0, 1] and T the d- dimensional torus. For a family of points T C T , the minimum separation 



is defined as the closest distance between any two elements from T, 

A(T) = inf \t-t'\, (1.5) 

where \t — t'\ is the l^ distance (maximum deviation in any coordinate). To be clear, this is the 
wrap-around distance so that for d = 1, the distance between t = and t! = 3/4 is equal to 1/4. 

Theorem 1.2 Let T = {tj} be the support of x. If the minimum distance obeys 

A(T)>2// C :=2A C , (1.6) 



then x is the unique solution to ( |1.4[ ). This holds with the proviso that f c > 128. If x is known to 
be real-valued, then the minimum gap can be lowered to 1.87 A c . 

We find this result particularly unexpected. The total-variation norm makes no real assumption 
about the structure of the signal. Yet, not knowing that there are any spikes, let alone how many 
there are, total-variation minimization locates the position of those spikes with infinite precision] 



Even if we knew that (1.4) returned a spike train, there is no reason to expect that the locations 
of the spikes would be infinitely accurate from coarse scale information only. In fact, one would 
probably expect the fitted locations to deviate at least a little from the truth. This is not what 
happens. 

The theorem does not depend on the amplitudes and applies to situations where we have both 
very large and very small spikes. The information we have about x is equivalent to observing 



the projection of x onto its low-frequency components, i.e. the constraint in (1.4) is the same as 
V n x = V n x, where V n = F^Fn- As is well known, this projection is the convolution with the 
Dirichlet kernel, which has slowly decaying side lobes. Hence, the theorem asserts that total- 
variation minimization will pull out the small spikes even though they may be completely buried in 
the side lobes of the large ones as shown in Figure [3j To be sure, by looking at the curves in Figure 
[3j it seems a priori impossible to tell how many spikes there are or roughly where they might be. 

An interesting aspect of this theorem is that it cannot really be tested numerically. Indeed, one 
would need a numerical solver with infinite precision to check that total-variation minimization 
truly puts the spikes at exactly the right locations. Although this is of course not available, Section 
ffl shows how to solve the minimum total- variation problem (1.4) by using ideas from semidefinite 



programming and allowing recovery of the support with very high precision. Also, we demonstrate 
through numerical simulations in Section [5] that Theorem 1.2 is fairly tight in the sense that a 
necessary condition is a separation of at least A c = l// c . 

Viewed differently, one can ask: how many spikes can be recovered from n = 2f c + 1 low-frequency 



samples? The answer given by Theorem 1.2 is simple. At least n/4 provided we have the minimum 
separation discussed above. A classical argument shows that any method whatsoever would at least 
need two samples per unknown spike so that the number of spikes cannot exceed half the number 
of samples, i. e. n/2. This is another way of showing that the theorem is reasonably tight. 

1.3 Super-resolution in higher dimensions 

Our results extend to higher dimensions and reveal the same dependence between the minimum 
separation and the measurement resolution as in one dimension. For concreteness, we discuss the 





Figure 3: Low-frequency projection of a signal corresponding to a signal with three (left) and 
seven (right) spikes. The blue curve represents the available data while the red ticks represent 
the unknown locations and relative amplitudes of the spikes. The locations of the spikes obey 



the condition of Theorem 1.2 Yet, by looking at the curves, it seems a priori impossible to 
tell how many spikes there are or roughly where they might be. 



2-dimensional setting and emphasize that the situation in d dimensions is similar. Here, we have a 
measure 

3 

as before but in which the tj G [0, l] 2 . We are given information about x in the form of low- frequency 
samples of the form 

y(k) 

'[o,i] s 



e- i2 ^ k ^x(dt)=J2^ e ~ iMk ' tj) : 



(fci,fc 2 )ez 2 , |fci|,|fo| </ c . 



(1.7) 



This again introduces a physical resolution of about A c = l// c - In this context, we may think 
of our problem as imaging point sources in the 2D plane — such as idealized stars in the sky — 
with an optical device with resolution about A c — such as a diffraction limited telescope. Our next 
result states that it is possible to locate the point sources without any error whatsoever if they are 
separated by a distance of 2.38 A c simply by minimizing the total variation. 



Theorem 1.3 Let T = {tj} C [0,1] 2 identified with T 2 be the support of x obeying the separation 
conditio^ 

A(T) > 2.38 /f c = 2.38 A c . (1.8) 

Then if x is real valued, it is the unique minimum total-variation solution among all real objects 



obeying the data constraints (1.7). Hence, the recovery is exact. For complex measures, the same 



statement holds but with a slightly different constant. 

Whereas we have tried to optimize the constant in one dimension_J we have not really attempted to 
do so here in order to keep the proof reasonably short and simple. Hence, this theorem is subject 
to improvement. 



Recall that distance is measured in £ 



This is despite the fact that the authors have a proof — not presented here — of a version of Theorem 
minimum separation at least equal to 1.85 A c . 



1.2 



with a 



Theorem 1.3 is proved for real- valued measures in Section [CJ of the Appendix. However, the proof 
techniques can be applied to higher dimensions and complex measures almost directly. In details, 
suppose we observe the discrete Fourier coefficients of a d- dimensional object at k = (fei, . . . , kd) € 
Z corresponding to low frequencies < |fci|, . . . , \kd\ < fc- Then the minimum total-variation 
solution is exact provided that the minimum distance obeys A(T) > Cd A c , where Cd is some positive 
numerical constant depending only on the dimension. Finally, as the proof makes clear, extensions 
to other settings, in which one observes Fourier coefficients if and only if the £2 norm of k is less or 
equal to a frequency cut-off, are straightforward. 

1.4 Discrete super-resolution 

Our continuous theory immediately implies analogous results for finite signals. Suppose we wish 
to recover a discrete signal x £ C^ from low-frequency data. Just as before, we could imagine 
collecting low-frequency samples of the form 

JV-l 
Vk = E xte~ i27tkt/N , \k\<f c ; (1.9) 

i=0 

the connection with the previous sections is obvious since x might be interpreted as samples of a 
discrete signal on a grid {t/N} with t = 0, 1, . . . , N — 1. In fact, the continuous-time setting is 
the limit of infinite resolution in which iV tends to infinity while the number of samples remains 
constant (/ c fixed). Instead, we can choose to study the regime in which the ratio between the 
actual resolution of the signal 1/N and the resolution of the data defined as l// c is constant. This 
gives the corollary below. 

Corollary 1.4 Let T C {0, 1, . . . , N — 1} be the support of {xt} t= Q obeying 

min —\t-t'\>2X c = 2/f c . (1.10) 

Then the solution to 

minH^I^ subject to F n x = y (141) 



in which F n is the partial Fourier matrix in (1.9) is exact. 



1.5 The super-resolution factor 

In the discrete framework, we wish to resolve a signal on a fine grid with spacing 1/N. However, we 
only observe the lowest n = 2/ c + 1 Fourier coefficients so that in principle, one can only hope to 
recover the signal on a coarser grid with spacing only 1/n as shown in Figure El Hence, the factor 
N/n, or equivalently, the ratio between the spacings in the coarse and fine grids, can be interpreted 
as a super-resolution factor (SRF). Below, we set 

SRF = N/n w N/2f c ; (1.12) 

when the SRF is equal to 5 as in the figure, we are looking for a signal at a resolution 5 times 
higher than what is stricto senso permissible. One can then recast Corollary |1.4| as follows: if the 
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Figure 4: Fine grid with spacing 1/N. We only observe frequencies between —f c and f c , 
fc/N « jSRF -1 , so that the highest frequency sine wave available has wavelength l// c = A c . 
These data only allow a Nyquist sampling rate of A c /2 s=s 1/n. In this sense, we can interpret 
the super-resolution factor N/n as the ratio between these two resolutions. 



nonzero components of {xt} t=0 
minimization occurs. 



are separated by at least 4 x SRF, perfect super-resolution via 



The reason for introducing the SRF is that with inexact data, we obviously cannot hope for infinite 
resolution. Indeed, noise will ultimately limit the resolution one can ever hope to achieve and, 
therefore, the question of interest is to study the accuracy one might expect from a practical 
super-resolution procedure as a function of both the noise level and the SRF. 



1.6 Stability 

To discuss the robustness of super-resolution methods vis a vis noise, we examine in this paper 



the discrete setting of Section 1.4 In this setup, we could certainly imagine studying a variety of 
deterministic and stochastic noise models, and a variety of metrics in which to measure the size 
of the error. For simplicity, we study a deterministic scenario in which the projection of the noise 
onto the signal space has bounded t\ norm but is otherwise arbitrary and can be adversarial. The 
observations are consequently of the form 



y = F n x + w, 



1 
N 



\KM\i<$ 



(1.13) 



for some 6 > 0, where F n is as before. Letting P n be the orthogonal projection of a signal onto 
the first n Fourier modes, P n = jjF*F n , we can view (1.13) as an input noise model since with 
w = F n z, we have 

y = F n (x + z), \\z\\ 1 < 8, z = P n z. 

Another way to write this model with arbitrary input noise z £ C^ is 



y = F n (x + z), \\P n z\\i < 5 

since the high-frequency part of z is filtered out by the measurement process. Finally, with s = 
(11 1 Sh is ermiva.1p.nt t.n 

= P n x + P n z, WPnzW^S. (1.14) 



N 1 F*y, ( |1.13[ ) is equivalent to 



In words, we observe a low-pass version of the signal corrupted with an additive low-pass error 
whose l\ norm is at most 5. In the case where n = N, P n = I, and our model becomes 



x + z, 



M|i <s. 



In this case, one cannot hope for a reconstruction x with an error in the t\ norm less than the 
noise level 5. We now wish to understand how quickly the recovery error deteriorates as the super- 
resolution factor increases. 



We propose studying the relaxed version of the noiseless problem (1.11) 



min \\x\\± subject to \\P n x — s| | x < 5. 



(1.15) 



We show that this recovers x with a precision inversely proportional to 5 and to the square of the 
super-resolution factor. 



(1.14), the solution x to (1.15) obeys 



Theorem 1.5 Assume that x obeys the separation condition (1.6). Then with the noise model 

(1.16) 



\x-x\\ l <C SRF Z S, 



for some positive constant Cq. 



This theorem, which shows the simple dependence upon the super-resolution factor and the noise 



level, is proved in Section 3 Clearly, plugging in 5 = in (1.16) gives Corollary 1.4 



Versions of Theorem |1.5| hold in the continuous setting as well, where the locations of the spikes 
are not assumed to lie on a given fine grid but can take on a continuum of values. The arguments 



are more involved than those needed to establish (1.16) and we leave a detailed study to a future 
paper. 



1.7 Sparsity and stability 

Researchers in the field know that super-resolution under sparsity constraints alone is hopelessly 
ill posed. In fact, without a minimum distance condition, the support of sparse signals can be 
very clustered, and clustered signals can be nearly completely annihilated by the low-pass sensing 
mechanism. The extreme ill-posedness can be understood by means of the seminal work of Slepian 



36 on discrete prolate spheroidal sequences. This is surveyed in Section 3.2 but we give here a 



concrete example to drive this point home. 



To keep things simple, we consider the 'analog version' of (1.14) in which we observe 



s = Vw(x + z); 



-i2nujt 



Vw(x) is computed by taking the discrete-time Fourier transform y(oo) = Yltez x t e ' Z7ru;t , w € 
[—1/2, 1/2], and discarding all 'analog' frequencies outside of the band [-W, W]. If we set 



2W = n/N = 1/SRF, 



we essentially have Vw = Pn where the equality is true in the limit where N — > oo (technically, 
Vw is the convolution with the sine kernel while P n uses the Dirichlet kernel). Set a mild level of 
super-resolution to fix ideas, 

SRF = 4. 

Now the work of Slepian shows that there is a £;-sparse signal supported on [0, . . . , k — 1] obeying 

V w x = \x, A«5.22VfcTTe~ 3 - 23(fc+1) . (1.17) 

For k = 48, 

A < 7 x 1(T 68 . (1.18) 

Even knowing the support ahead of time, how are we going to recover such signals from noisy 
measurements? Even for a very mild super-resolution factor of just SRF = 1.05 (we only seek to 



extend the spectrum by 5%), (1.17) becomes 



V w x = Xx, A«3.87^/fcTTe- ai5(fc+1) , (1.19) 

which implies that there exists a unit-norm signal with at most 256 consecutive nonzero entries such 
that H'Pvk^I^ ^ 1-2 x 10~ 15 . Of course, as the super-resolution factor increases, the ill-posedness 



gets worse. For large values of SRF, there is x obeying (1.17) with 



log A « -(0.4831 + 2 log(SRF))fc. (1.20) 

It is important to emphasize that this is not a worst case analysis. In fact, with k = 48 and 
SRF = 4, Slepian shows that there is a large dimensional subspace of signals supported on C k 



spanned by orthonormal eigenvectors with eigenvalues of magnitudes nearly as small as (1.18). 



1.8 Comparison with related work 

The use of i\ minimization for the recovery of sparse spike trains from noisy bandlimited mea- 
surements has a long history and was proposed in the 1980s by researchers in seismic prospect- 
ing 18,27,35]. For finite signals and under the rather restrictive assumption that the signal is real 



valued and nonnegative, |20| and |12| prove that k spikes can be recovered from Ik + 1 Fourier 
coefficients by this method. The work [9] extends this result to the continuous setting by using 
total-variation minimization. In contrast, our results require a minimum distance between spikes 
but allow for arbitrary complex amplitudes, which is crucial in applications. The only theoretical 
guarantee we are aware of concerning the recovery of spike trains with general amplitudes is very 
recent and due to Kahane [24]. Kahane offers variations on compressive sensing results in [6j and 
studies the reconstruction of a function with lacunary Fourier series coefficients from its values in 



a small contiguous interval, a setting that is equivalent to that of Corollary 1.4 when the size iV of 



the fine grid tends to infinity. With our notation, whereas we require a minimum distance equal 
to 4 x SRF, this work shows that a minimum distance of 10 x SRF-^/log SRF is sufficient for exact 
recovery. Although the log factor might seem unimportant at first glance, it in fact precludes ex- 



tending Kahane's result to the continuous setting of Theorem 1.2. Indeed, by letting the resolution 
factor tend to infinity so as to approach the continuous setting, the spacing between consecutive 
spikes would need to tend to infinity as well. 
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As to results regarding the robustness of super-resolution in the presence of noise, Donoho |10| 
studies the modulus of continuity of the recovery of a signed measure on a discrete lattice from 



its spectrum on the interval [— f c ,fc], a setting which is also equivalent to that of Corollary 1.4 
when the size N of the fine grid tends to infinity. More precisely, if the support of the measure 
is constrained to contain at most £ elements in any interval of length 2/(£f c ), then the modulus 
of continuity is of order O (SRF +1 ) as SRF grows to infinity (note that for £ = 1 the constraint 
reduces to a minimum distance condition between spikes, which is comparable to the separation 



condition (1.6)). This means that if the £2 norm of the difference between the measurements 
generated by two signals satisfying the support constraints is known to be at most 5, then the £2 
norm of the difference between the signals may be of order O (SRF + 5) . This result suggests that, 
in principle, the super-resolution of spread-out signals is not hopelessly ill-conditioned. Having said 
this, it does not propose any practical recovery algorithm (a brute-force search for sparse measures 
obeying the low- frequency constraints would be computationally intractable). 

Finally, we would like to mention an alternative approach to the super-resolution of pointwise events 
from coarse scale data. Leveraging ideas related to error correction codes and spectral estimation, 
|15| shows that it is possible to recover trains of Dirac distributions from low-pass measurements 
at their rate of innovation (in essence, the density of spikes per unit of time). This problem, 
however, is extraordinarily ill posed without a minimum separation assumption as explained in 



Sections 1.7 and 3.2 Moreover, the proposed reconstruction algorithm in 15 needs to know the 
number of events ahead of time, and relies on polynomial root finding. As a result, it is highly 
unstable in the presence of noise as discussed in [37], and in the presence of approximate sparsity. 
Algebraic techniques have also been applied to the location of singularities in the reconstruction 



of piecewise polynomial functions from a finite number of Fourier coefficients (see flip, 18 and 



references therein) . The theoretical analysis of these methods proves their accuracy up to a certain 



limit related to the number of measurements. Corollary 1.6 takes a different approach, guaranteeing 



perfect localization if there is a minimum separation between the singularities. 
1.9 Connections to sparse recovery literature 



Theorem |1.2| and Corollary 1.4 can be interpreted in the framework of sparse signal recovery. For 



instance, by swapping time and frequency, Corollary 1.4 asserts that one can recover a sparse 



superposition of tones with arbitrary frequencies from n time samples of the form 

AT-l 

Vt= J>,e- l27rt ^, t = 0,l,...,n-l 

j=0 

where the frequencies are of the form u>j = j/N . Since the spacing between consecutive frequencies 
is not 1/n but 1/JV, we may have a massively oversampled discrete Fourier transform, where the 
oversampling ratio is equal to the super-resolution factor. In this context, a sufficient condition for 



perfectly super-resolving these tones is a minimum separation of 4/n. In addition, Theorem 1.2 
extends this to continuum dictionaries where tones uij can take on arbitrary real values. 

In the literature, there are several conditions that guarantee perfect signal recovery by £\ mini- 
mization. The results obtained from their application to our problem are, however, very weak. 



The matrix with normalized columns fj = {e J /y / n}™ =0 does not obey the restricted 
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isometry property [7] since a submatrix composed of a very small number of contiguous 



columns is already very close to singular, see 36 and Section 3.2 for related claims. For ex- 



ample, with N = 512 and a modest SRF equal to 4, the smallest singular value of submatrices 
formed by eight consecutive columns is 3.32 10 -5 . 

Applying the discrete uncertainty principle proved in [11] , we obtain that recovery by i\ 
minimization succeeds as long as 

2 \T\ (N-n)< N. 

If n < N/2, i.e. SRF > 2, this says that \T\ must be zero. In other words, to recover one 
spike, we would need at least half of the Fourier samples. 

Other guarantees based on the coherence of the dictionary yield similar results. A popular 
condition J39J requires that 

|T|< ^(M-i + l), (1.21) 

where M is the coherence of the system defined as max^j \(fi,fj)\- When N = 1024 and 
SRF = 4, M ~ 0.9003 so that this becomes \T\ < 1.055, and we can only hope to recover one 
spike. 



There are slightly improved versions of (1.21). In 13 , Dossal studies the deconvolution of spikes 



by i\ minimization. This work introduces the weak exact recovery condition (WERC) defined as 

/3(T) 



WERC (T) 
where 



1 - a (T) ' 



a(T) = sup J2 K/*»/i>l» /3(T) = sup^|(/ l ,/ J )|. 

lGT j£T/{i} l£TC jGT 

The condition WERC (T) < 1 guarantees exact recovery. Considering three spikes and using Taylor 
expansions to bound the sine function, the minimum distance needed to ensure that WERC (T) < 1 
may be lower bounded by 24SRF /ir s — 2SRF. This is achieved by considering three spikes at 
u> £ {0, ±A}, where A = (k + 1/2) jn for some integer k; we omit the details. If N = 20, 000 and 
the number of measurements is 1,000, this allows for the recovery of at most 3 spikes, whereas 



Corollary 1.4 implies that it is possible to reconstruct at least n/4 = 250. Furthermore, the cubic 



dependence on the super-resolution factor means that if we fix the number of measurements and 



let N — > oo, which is equivalent to the continuous setting of Theorem 1.2, the separation needed 



becomes infinite and we cannot guarantee the recovery of even two spikes. 

Finally, we would also like to mention some very recent work on sparse recovery in highly coherent 



frames by modified greedy compressed sensing algorithms 16,191. Interestingly, these approaches 
explicitly enforce conditions on the recovered signals that are similar in spirit to our minimum 
distance condition. As opposed to £i-norm minimization, such greedy techniques may be severely 
affected by large dynamic ranges (see [19] ) because of the phenomenon illustrated in Figure |3J 
Understanding under what conditions their performance may be comparable to that of convex 
programming methods is an interesting research direction. 
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1.10 Extensions 

Our results and techniques can be extended to super-resolve many other types of signals. We just 
outline such a possible extension. Suppose x : [0, 1] — > C is a periodic piecewise smooth function 
with period 1, defined by 

on each time interval (tj—x,tj), x is polynomial of degree £. For £ = 0, we have a piecewise constant 
function, for £ = 1, a piecewise linear function and so on. Also suppose x is globally £ — 1 times 
continuously differentiable (as for splines). We observe 

Vk= I x(t)e- i2 * kt dt, \k\<f c . 
J[0,1] 

The {£ + l)th derivative of x (in the sense of distributions) denoted by x" +1 ) is an atomic measure 
supported on T and equal to 

*(*»> = £Mt,, cy=pg 1 (*i)-pf(* i ). 

i 
Hence, we can imagine recovering x" +1 ) by solving 

min ||ar + ^ ||tv subject to F n x = y. (1-22) 

Standard Fourier analysis gives that the fcth Fourier coefficient of this measure is given by 

y% +1) = (i2wk) t+1 Vk , k + 0. (1.23) 

Hence, we observe the Fourier coefficients of x^ +1 ' except that corresponding to k = 0, which must 
vanish since the periodicity implies L x^- +l '(dt) = = L x^'(t)dt, 1 < j < ^. Hence, it follows 
from Theorem 



1.2 



that (1.22) recovers £^ +1 ) exactly as long as the discontinuity points are at least 
2A C apart. Because x is £ — 1 times continuously differentiable and periodic, x^- +l ' determines x 
up to a shift in function value, equal to its mean. However, we can read the mean value of x off 
yo = J" x(t)dt and, therefore, (1.22) achieves perfect recovery. 



Corollary 1.6 IfT = {tj} obeys (1.6), x is determined exactly from y by solving (1.22). 



Extensions to non-periodic functions, other types of discontinuities and smoothness assumptions 
are straightforward. 

1.11 Organization of the paper 

The remainder of the paper is organized as follows. We prove our main noiseless result in Section [2j 
There, we introduce our techniques which involve the construction of an interpolating low-frequency 
polynomial. Section [3] proves our stability result and argues that sparsity constraints cannot be 
sufficient to guarantee stable super-resolution. Section S shows that (1.4) can be cast as a finite 



semidefinite program. Numerical simulations providing a lower bound for the minimum distance 
that guarantees exact recovery are presented in Section [5} We conclude the paper with a short 
discussion in Section [HI 
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(a) 



(b) 



Figure 5: (a) Low-frequency polynomial interpolating a sign pattern in which the support 
is well separated, and obeying the off-support condition (2.2). In (b), we see that if the 



spikes become very near, we would need a rapidly (high-frequency) interpolating polynomial 



in order to achieve (2.2). This is the reason why there must be a minimum separation between 
consecutive spikes. 



2 Noiseless Recovery 



This section proves the noiseless recovery result, namely, Theorem 1.2 Here and below, we write 
A = A(T) > A m i n = 2 A c . Also, we identify the interval [0, 1) with the circle T. 



2.1 Dual polynomials 



In the discrete setting, the compressed sensing literature has made clear that the existence of a 
certain dual certificate guarantees that the t\ solution is exact [6]. In the continuous setting, a 
sufficient condition for the success of the total-variation solution is this: for any v G C' T ' with 
\vA = 1, there exists a low- frequency trigonometric polynomial 



?(*) 



fc 
fc=-/c 



i2-rrkt 



(2.1) 



tj G T, 



(2.2) 



obeying the following properties 

(q(tj) =Vj, 
\|g(t)|<l, t€T\T. 

This result follows from elementary measure theory and is included in Section [A] of the Appendix 
for completeness. Constructing a bounded low-frequency polynomial interpolating the sign pattern 
of certain signals becomes increasingly difficult if the minimum distance separating the spikes is too 
small. This is illustrated in Figure [5| where we show that if spikes are very near, it would become 
in general impossible to find an interpolating low-frequency polynomial obeying (2.2). 
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2.2 Proof of Theorem Ol 



Theorem |1.2| is a direct consequence of the proposition below, which establishes the existence of a 
valid dual polynomial provided the elements in the support are sufficiently spaced. 

Proposition 2.1 Let v G C' T ' be an arbitrary vector obeying \vj\ = 1. Then under the hypotheses 



of Theorem 1.2, there exists a low-frequency trigonometric polynomial (2.1) obeying (2.2). 



The remainder of this section proves this proposition. Our method consists in interpolating v on 
T with a low-frequency kernel and correcting the interpolation to ensure that the derivative of the 
dual polynomial is zero on T. The kernel we employ is 

4 



K(t) 



sin 



k. 



+ i hrf 



&■ + l)sin(vrt) 



0< t < 1, 



(2.3) 



and K(0) = 1. If f c is even, K(t) is the square of the Fejer kernel which is a trigonometric 



polynomial with frequencies obeying |A;| < / c /2. As a consequence, K is of the form (2.1). The 



careful reader might remark that the choice of the interpolation kernel seems somewhat arbitrary. 
In fact, one could also use the Fejer kernel or any other power of the Fejer kernel using almost 
identical proof techniques. We have found that the second power nicely balances the trade-off 
between localization in time and in frequency, and thus yields a good constant. 



To construct the dual polynomial, we interpolate v with both K and its derivative K' , 

q(t) = J2 ^K{t - tj) + PjK'(t - tj), 



(2.4) 



where a, /3 G C' T ' are coefficient sequences. The polynomial q is as in (2.1) and in order to obey 
q{tk) = Vki we impose 



?(**;) = 5Z a 3 K ( tk ~ *J') + fo K> ( tk ~ *J') = Vk ' Vffc G T ' 



(2.5) 



whereas in order to obey \q(t)\ < 1 for t G T c , we impose q'(tk) = 0, 



(2.6) 



As we will see, this implies that the magnitude of q reaches a local maximum at those points, which 



in turn can be used to show that (2.2) holds. 



The proof of Proposition 2.1 consists of three lemmas, which are the object of the following section. 
The first one establishes that if the support is spread out, it is possible to interpolate any sign 
pattern exactly. 



Lemma 2.2 Under the hypotheses of Proposition 2.1, there exist coefficient vectors a and (3 obeying 



Halloo <« 
ll/3|loo</3° 



1 + 8.824 10" 
3.294 1(T 2 X r 



(2.7) 
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such that (2.5) -(2.6) hold. Further, if v\ = 1, 



Reai > 1-8.824 10 



-3 



llmail < 8.824 10 



-3 



(2.8 



To complete the proof, Lemmas 2.3 and 2.4 show that \q (t) | < 1. 



Lemma 2.3 Fix r G T. Under the hypotheses of Proposition 2.1, \q(t)\ < 1 for \t — r\ G 
(0,0.1649 A c ]. 



Lemma 2.4 Fix r E T. Then under the hypotheses of Proposition 2.1, \q(t)\ < 1 for \t — r\ G 



[0.1649 A c , A/2]. This can be extended as follows: letting t + be the closest spike to the right, 
i. e. r+ = min{£ G T : t > r}. Then \q(t)\ < 1 for all t obeying < t — t < (r + — t)/2, and likewise 
for the left side. 

Finally, we record a useful lemma to derive stability results. 
Lemma 2.5 If A (T) > 2.5 A c , then for any r € T, 



\q(t)\ < 1 - 0.3353/ c 2 (t - r) 2 , for all t : \t - t\ < 0.1649 A c . 



(2.9) 



Further, for min T6 T |* — 7"| > 0.1649 A C; |g(t)| is upper bounded by the right-hand side above eval- 
uated at 0.1649 A r . 



Section 2.5 describes how the proof can be adapted to obtain a slightly smaller bound on the 



minimum distance for real-valued signals. 

2.3 Proofs of Lemmas 

The proofs of the three lemmas above make repeated use of the fact that the interpolation kernel 
and its derivatives decay rapidly away from the origin. The intermediate result below proved in 
Section [B] of the Appendix quantifies this. 

Lemma 2.6 For £ E {0,1,2,3}, let K® be the £th derivative of K (K = K^). For \f~ x = 
^A c < t < g, we have 

n e H e (t) 



K®(t) 



Bi(t) 



n"H? 



where Hq° 



< B e (t) = 

1, JJf° = 4, H%° = 18, Hf = 77 
H (t) = a\t), 



(/ c +2)4-« 4 4 • 



\\ c <t< V2/7T, 

\/2/vr< t < \. 



2" 



H 1 (t) = a\t)(2 + 2b(t)), 

H 2 (t) = a\t)(4 + 7b(t)+6b 2 (t)), 

H 3 (t) = a 4 (t) (8 + 246(t) + 306 2 (t) + 156 3 (t)) 
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and 



a(t) 



nil 



nH< 



b(t) 



1 a(t) 
Jc~' 



For each I, the bound on the magnitude of Bi(t) is nonincreasing in t and Bi(A — t) + Bi(A + 1) 
is increasing in t for < t < A/2 if < A + 1 < t/2/tt. 

This lemma is used to control quantities of the form Ylt-&T\fr} \^ (^ ~~ ^*)l ( r e -0 as shown below. 



Lemma 2.7 Suppose G T. T/ien /or aW t G [0, A/2], 



^ |^ (£) (t - U)\ < Ft (A,t) = F+(A,t) + F-(A,t) + F,°°(A min ), 
t*eT\{o} 



where 



A«+<3A n 



F+(A, t) = max J max K^ (i - t+) , B e (3A min - t) \ + V B £ (jA min - t 



20 



3=2 



i 7 ^ (A, t) = max -| ^ max 
_r^> (A m i n 



r i 20 

<^ max K® (t_) , 5 £ (3A min ) I + J^ B e {jA min + i), 

J=2 



A<i_<3A min 



\j c i ~; mm 



7T 

45 



19 



< 8.98 10 



-5 



3=1 



Moreover, Fi (A,t) is nonincreasing in A for all t, and Fi (A mm ,£) is nondecreasing in t. 

Proof We consider the sum over positive U £ T first and denote by t+ the positive element in T 
closest to 0. We have 



£ \K^(t-U)\ = \K^(t-t + ) 

U£T:0<ti<l/2 



+ E 

UeT\{t+}:0<U<l/2 



K^ (t - U) 



(2.10) 



Let us assume t + < 2A m ; n (if t + > 2A m j n the argument is very similar). Note that the assumption 
that f c > 128 implies 2lA mm < 0.33 < y2/n. By Lemma 2.6 and the minimum separation 



condition, this means that the second term in the right-hand side is at most 

20 £ oo 

E ^(J Amin ~t)+ I t J2 



H r ; 



i=2 



(/c + 2) 



i=2i 



which can be upper bounded using the fact that 



E 

i=2i 



m 



< 



j=20 



m 



m 



\JJl\tdxo. ^t ^J i'=20 U^millJ min \ „_i J .-_1 J 



oo -. 19 -. 



(jA min ± t) 






(2.11) 
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mm X j—i 



3=1 



-mm \ "^ j^i J' 



2A 4 . ' 

mm 
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the first inequality holds because t < A m ; n and the last because the Riemann zeta function is equal 
to vr 4 /90 at 4. Also, 



K® (t - t+) 



< 



\ max A <t + <3A min \K^ (t -t+)\, t+ < 3A min , 
[-B^(3A min — t), t + > 3A min . 



Hence, the quantity in (2.10) is bounded by F7(A,t) + F^°°(A m i n )/2. A similar argument shows 
that the sum over negative U £ T is bounded by F^(A,t) + F^°°(A m i n )/2. 

To verify the claim about the monotonicity w.r.t. A, observe that both terms 

K^(t-t+) , B e (3A min - t)\ and max I max K^ (t_) , B e (3A min ) 



max <; max 

A<t+<3A min 



are nonincr easing in A. 

Fix A = A m i n now. Since Bi (jA — t) + Bi (jA + 1) is increasing in t for j < 20 (recall that 
21A m ; n < \/2/7r), we only need to check that the first term in the expression for Ft is nondecreasing 
in t. To see this, rewrite this term (with A = A m ; n ) as 



max 



max 
-£<u<3A m i n — t 



K^(u)\,B e (3A min -t)\ 



Now set t' > t. Then by Lemma 2.6 

Bi (3A min — t)> 
Also, we can verify that 



B( (3A m j n — t) , 

\K(u)\, 



u> 3A n 



max 

A min -i'<«<3A min -i' 

This concludes the proof. 



K it) 



> 



max 
-t<n<3A n 



K® (u) 



In the proof of Lemmas 2.3 and 2.4, it is necessary to find a numerical upper bound on l^(A m j n , t) 
at t £ {0, 0.1649 A c , 0.4269 A c , 0.7559 A c } (for the last two, we only need bounds for £ = 0, 1). For a 
fixed t, it is easy to find the maximum of \K^> (t — t + )\ where t+ ranges over [A m i n ,3A m ; n ] since 
we have expressions for the smooth functions K^> (see Section pi of the Appendix). For reference, 
these functions are plotted in Figure [6} The necessary upper bounds are gathered in Table [T] 

Finally, a last fact we shall use is that K (0) = 1 is the global maximum of K and |-PC"(0)| = 
— 7T 2 / C (f c + 4) /3 the global maximum of \K"\. 



2.3.1 Proof of Lemma HH 

Set 



(D ) jk = K (tj - t k ) , (Di) jk = K' (tj - t k ) , (D 2 ) jk = K" (tj - t k ) , 
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t/Xc 


F (1.98A c ,t) 


Fi(1.98A c ,i) 


F 2 (1.98A c ,t) 


F 3 (1.98A c ,t) 





6.253 10~ 3 


7.639 10" 2 /c 


1.053 / 2 


8.078 / 3 


0.1649 


6.279 10" 3 


7.659 10" 2 / c 


1.055/ 2 


18.56 / 3 


0.4269 


8.029 10" 3 


0.3042/ c 






0.7559 


5.565 10~ 2 


1.918/ c 







x10 



Table 1: Numerical upper bounds on F^(1.98A c ,t). 




— IK(t)l 
_IK'(t)l/f 



(a) 



0.12 
0.1 
0.08 
0.06 
0.04 
0.02 






— IK"(t)l/£ 
— IK'"(t)l/£ 




- 



(b) 



Figure 6: \K^ (t)\ for t G [A m j n , 3A m i n ]. The scaling of the x-axis is in units of A c . 
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where j and k range from 1 to \T\. With this, (2.5) and (2.6) become 



~D Di 
D x D 2 _ 




a 

A 


= 


V 





A standard linear algebra result asserts that this system is invertible if and only if D 2 and its Schur 
complement D$ — D\D^ D\ are both invertible. To prove that this is the case we can use the fact 
that a symmetric matrix M is invertible if 



\I-M\\ OQ <l, 



where ||^4||oo is the usual infinity norm of a matrix defined as ||^4||oo 
max* £\ \aij\. This follows from Af" 1 = (I - H)- 1 = J2 k >o #*> H = I 
convergent since H-ffHoo < 1. In particular, 



AT 



< — 

loo — 1 



1 



|/-M|| C 



(2.12) 

: maX ||x||oo = l Halloo = 

M, where the series is 



(2.13) 



We also make use of the inequalities below, which follow from Lemma 2.7 



\I-D \ 
IIAI 



<F (A min ,0)< 6.253 1(T 3 , 
<F!(A min ,0)< 7.639 W- 2 f c , 



(2.14) 
(2.15) 
(2.16) 



\\\K"(0)\ I- D2L < F 2 (A min ,0) < 1.053 fl 
Note that D 2 is symmetric because the second derivative of the interpolation kernel is symmetric. 



The bound fl2.16[ ) and the identity K" (0) = -tt 2 /c (/ c + 4) /3 give 

D 2 



I- 



K" 



<1, 



which implies the invertibility of D 2 . The bound (2.13) then gives 

1-1 



LDo 



< 



1 



\K"(0)\-\\\K"(0)\I-D 2 \ 
Combining this with (|2.14[) and (2.15|) yields 



< 



0.4275 



Pc 



(2.17) 



Dn 



D.D^Di 



< WI-D, 







+ \\D 1 \\i \\D. 



-11 

2 I 



< 8.747 W~ 6 < 1. 



(2.18) 



Note that the Schur complement of D 2 is symmetric because Dq and D 2 are both symmetric 
whereas Df = —D\ since the derivative of the interpolation kernel is odd. This shows that the 
Schur complement of D 2 is invertible and, therefore, the coefficient vectors a and /3 are well defined. 

There just remains to bound the interpolation coefficients, which can be expressed as 



-D^Di 



-1 



C~ L v, C :=D -D 1 D~ l D 1 
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where C is the Schur complement. The relationships (2.13) and (2.18) immediately give a bound 
on the magnitude of the entries of a 



a 



|C _1 v|| ^IIC" 1 !! < 1 + 8.824 1(T 3 . 



Similarly, (2.15), (2.17) and (2.18) allow to bound the entries of j3: 



Plloo^ll^Ac- 1 ! 



< \\D~r, 



l^ilLlIC" 1 !! < 3.294 10" 2 A c . 



Finally, with v\ = 1, we can use (2.18) to show that o.\ is almost equal to 1. Indeed, 



hil < \\l-C~ l \\ , and 

1 '- L| — I I I loo' 

Wi-c^W 

II lie 

This concludes the proof. 



ai = l-7i, 71 = [(/- C 1 )v]i, 



\C- l (I-C)\\ <||C- 1 || 11/- CI L < 8.824 10" 

v 'no — no 11 I loo — 



2.3.2 Proof of Lemma [2731 



We assume without loss of generality that r = and q(0) = 1. By symmetry, it suffices to show 
the claim for t £ (0,0.1649 A c ]. Since q'(0) = 0, local strict concavity would imply that \q(t)\ < 1 
near the origin. We begin by showing that the second derivative of \q\ is strictly negative in the 
interval (0, 0.1649 A c ). This derivative is equal to 



d 2 |g| 
dt 2 



(t) 



(MR (*) Qr (*) + Qi (*) gH*)) 2 + W(t)\ 2 + QR (t) q'k (t) + qj (*) 41 (t) 



■(*)!' 



■(*)l 



where qn is the real part of q and qi the imaginary part. As a result, it is sufficient to show that 



qR(t)q R (t) + \q'(t)\ 2 + \q I (t)\\q'l(t)\<0, 



(2.19) 



as long as \q(t)\ is bounded away from zero. In order to bound the different terms in (2.19), we 
use the series expansions of the interpolation kernel and its derivatives around the origin to obtain 
the inequalities, which hold for all t £ [—1/2, 1/2], 



i\- 



K{t)>l--f c {f c + A)t\ 
6 

|tf'(t)|<y/c(/c + 4)t, 

K" (t) < ~f c (f c + 4) + ^ (/ c + 2) 4 t\ 
3 o 

|K"(i)|<y/ c (/ c + 4), 

7T 4 



\K'"{t)\<-{f c + 2Tt. 



(2.20) 
(2.21) 
(2.22) 
(2.23) 
(2.24) 
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The lower bounds are decreasing in t, while the upper bounds are increasing in t, so we can evaluate 
them at 0.1649 A c to establish that for all t G [0, 0.1649 A c ], 



K (t) > 0.9539, K" (t) < -2.923 / c 2 , 

\K'(t)\ < 0.5595 f c , \K"(t)\ < 3.393 J 2 , \K'" (t)\ < 5.697 / c 3 . 



(2.25) 



We combine this with Lemmas 2.7 and 2.2 to control the different terms in (2.19) and begin with 
qil(t). Here, 



(W 



(t) = ^ Re (a,) K(t- tj) + Re (fa) K' (t - tj) 

t 3 &T 

>Re(a 1 )i^(t)-||a|| 0O E \K (t - tj )\ - M^ E \K' (t - tj)\ 

tj£T\{0} tj£T 

> Re (ai) K (t) - a°°F (A, t) - (3°° (\K' (t)\ + F t (A, t)) 
>Re(ai)K(t)-a oo F (A min ,t)-/3 oo (|K / (t)|+F 1 (A min ,t)) > 0.9182. (2.26) 



The third inequality follows from the monotonicity of Fg in A, and the last from (2.25) together 



with the monotonicity of F\ (A m i n ,t) in t, see Lemma 2.7 so that we can plug in t = 0.1649 A c . 
Observe that this shows that q is bounded away from zero since \q(t)\ > qn(t) > 0.9198. Very 
similar computations yield 



and 



// 
9r 



\qi (t)\= Y, Im («i) K (t~ h) + Im (Pj) K ' (* " tj) 



< |Im(ai)| + \\a\\ oa E \K (t - tj)\ + \\(3\\oo E \ K ' (* " *i)| 

i je r\{0} tjET 

<|Im(a 1 )| + a oo F (A min ,t) + /3 oo (|K , (t)|+F 1 (A min ,t)) < 3.611 10~ 2 



(i) = E Re («i) K " ( f " *i) + E Re (ft') K '" (' " *i) 

<Re(a 1 )K"(t) + \\a\\ 00 E I*" (*~ *i)| + Halloo E \ K '" (*~*i)| 

tj6!T\{0} t.eT 

< Re (oi) K" (t) + a°°F 2 (A min , t) + /3°° (|if w (t)| + F 3 (A min , i)) < -1.034 / 2 . 



(2.27) 



Similarly, 



l it (j.\ l 
9/(*) 



E Im (aj) K" (t - tj ) + E Im (Pi) K'» (t - tj 



<lm(a 1 )\K"(t)\ + \\a\\ 00 E \ K " (* " **)| + Halloo E \ K '" (* ~ *>)l 

t j6 T\{0} %ST 

< Im( ai ) |if" (t)| + a°°F 2 (A min ,t) + /3°° (|tf'" (t)| + F 3 (A min ,t)) < 1.893 / 2 
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and 



W(t)\ 



Y^ OijK 1 (t - tj) + PjK" (t - t 3 



< IMU H\K'(t-tj)\ + ML EI^C-^I 



< a°° |K' (t)\ + a°°Fi (A min ,t) + /3°° fltf" (t)| + F 2 (A min ,t)) < 0.7882 f c 
These bounds allow us to conclude that \q\" is negative on [0,0.1649A C ] since 

QR (t) QR (t) + \q (t)f + \qi (t)\ \q'{ (t)\ < -9.291 lO" 2 / 2 < 0. 
This completes the proof. 

2.3.3 Proof of Lemma HH 



As before, we assume without loss of generality that r = and q(0) = 1. We use Lemma 2.7 again 
to bound the absolute value of the dual polynomial on [0.1649A C , A/2] and write 



\q(t)\ = \j2 oljK (t - tj) + f3jK' (t - tj 



< a 



[\K(t)\+ J2 \ K ^~h 

tj&T\{0} 



+ m\oo[\K'(t)\+ Yl \^(*-*i 

tj&T\{0} 



< a°° \K (t)\ + a°°F (A min ,t) + /3°° \K' (t)\ + /3°°Li (A min ,t) . 



(2.28) 



Note that we are assuming adversarial sign patterns and as a result we are unable to exploit 
cancellations in the coefficient vectors a and /3. To control |-K"(i)| and |if'(t)| between 0.1649 A c 
and 0.7559 A c , we use series expansions around the origin which give 



K{t) , l * 2 fc(fc + 4)t 2 | vr 4 (/ c + 2) 4 t 4 



| K'(t)\ 



< 



6 

7T 2 fc (fc + 4) t 



72 



(2.29) 



for allte [-1/2,1/2]. Put 

Li (t) = a° 
with derivative equal to 



i vr 2 / c (/ c + 4)t 2 | 7r 4 (/ c + 2)V 



(» 



72 



+ /3 C 



,7T 2 / c (/ c + 4)t 



Li (t) = -a c 



^ 2 /c(/c + 4)t 7T 4 (/ c + 2) 4 t 3 l , ooo7r 2 /c (/ c + 4) 



18 



+ /3 C 



This derivative is strictly negative between 0.1649 A c and 0.7559 A c , which implies that L\ (t) is 
decreasing in this interval. Put 

L 2 (t) = a°°F (A min , t) + (3°°F 1 (A min , t) . 
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By Lemma 2.7 this function is increasing. With (2.28), this gives the crude bound 



\q(t)\<L 1 (t)+L 2 (t)<Li(ti)+L 2 (t 2 ) for alii € [t u t 2 ]. (2.30) 

Table[2]shows that taking {h,t 2 } = {0.1649 A c , 0.4269 A c } and then {t u t 2 } = {0.4269 A c , 0.7559 A c } 
proves that \q(t)\ < 1 on [0.1649A C , 0.7559A C ]. For 0.7559A C < t < A/2, we apply Lemma |2~6| and 
obtain 

oo oo 

\q(t)\ < a°° \b (t) + B (A-t) + Y,B (jA min + A - t) + ^ B (jA min + t) 



i=i 



i=i 



/3 C 



B x [t) + B 1 {A-t) + J2 B ± 0' A min + A - t) + ]T B x (j A min + t) 



i=i 



i=i 



<a c 



B (0.7559A C ) + ^2 B o U Amin - 0.7559A C ) + ^ £? (jA min + 0.7559A C 



/3 C 



Si (0.7559A C ) + ^ Bx (jA min - 0.7559A C ) + ^ #i (jA min + 0.7559A C 
i=i i=i 



< 0.758; 



here, the second step follows from the monotonicity of -Bo and B\. Finally, for A/2 < t < t+/2, 
this last inequality applies as well. This completes the proof. 



h/K 


t 2 /\c 


Li (h) 


L 2 (t 2 ) 


0.1649 


0.4269 


0.9818 


1.812 10" 2 


0.4269 


0.7559 


0.7929 


0.2068 



Table 2: Numerical quantities used in (2.301 



2.4 Proof of Lemma 12.51 

Replacing A = 1.98 A c by A = 2.5 A c and going through exactly the same calculations as in Sections 



2.3.1| and [2X2| yields that for any t obeying < \t - t\ < 0.1649 A c , 

d 2 \q\ 



dt 2 



(t) < -0.6706/;. 



For reference, we have computed in Table[3]numerical upper bounds on i^(2.5A c , t) at t = {0, 0.1649 A}. 
Since \q(0)\ = 1 and q'(0) = 0, it follows that 



k(t)|<k(0)|- 2 0.6706/ 2 i 2 . 



(2.31) 



At a distance of 0.1649 A c , the right-hand side is equal to 0.9909. The calculations in Section [2.3. 3| 
with A = 2.5 A c imply that the magnitude of q(t) at locations at least 0.1649 A c away from an 
element of T is bounded by 0.9843. This concludes the proof. 
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t/Xc 


F (2.5Ac,<) 


Fi(2.5A c ,i) 


F 2 {2.5X c ,t) 


F 3 (2.5A c ,t) 





5.175 10" 3 


6.839 10" 2 / c 


0.8946 fl 


7.644 fl 


0.1649 


5.182 10~ 3 


6.849 10" 2 /c 


0.9459 / 2 


7.647 j 'I 



Table 3: Numerical upper bounds on i*^(2.5A c , t). 



2.5 Improvement for real- valued signals 

The proof for real- valued signals is almost the same as the one we have discussed for complex- valued 
signals — only simpler. The only modification to Lemmas 2.2 and 2.4 is that the minimum distance 



is reduced to 1.87 A c , and that the bound in Lemma [2T4| is shown to hold starting at 0.17 A c instead 
of 0.1649 A c . For reference, we provide upper bounds on i^(1.87A c ,t) at t € {0, 0.17 A c } in Table 
Hi As to Lemma 2.3, the only difference is that to bound \q\ between the origin and 0.17 A c , it is 
sufficient to show that the second derivative of q is negative and make sure that q > — 1. Computing 
( [237] for A = 1.87A C for t <G [0,0.17A C ], we obtain q" < -0.1181. Finally, fl2~26"l ) yields q > 0.9113 
in [0,0.17A C ]. 



t/x c 


F (1.87A c> t) 


Fi(1.87A c ,t) 


F 2 (1.87A c ,t) 


F 3 (1.87A c ,t) 





6.708 10" 3 


7.978 10" 2 / c 


1.078/2 


16.01 f c 


0.17 


6.747 10" 3 


0.1053/ c 


1.081/1 


41-74 fl 



Table 4: Numerical upper bounds on F^(1.87A C ,£). 



3 Stability 



This section proves Theorem 1.5 and we begin by establishing a strong form of the null-space 
property. In the remainder of the paper Pt is the orthogonal projector onto the linear space of 
vectors supported on T, namely, {Ptx)i = Xi if i £ T and is zero otherwise. 

Lemma 3.1 Under the assumptions of Theorem \1.5\ any vector h such that F n h = obeys 

\\Frh\\ x <p\\Pr°h\\ Xi (3.1) 

for some numerical constant p obeying < p < 1. This constant is of the form 1 — p = a/SRF 
for some positive a > 0. // SRF > 3.03 ; we can take a = 0.0883. 

Proof Let Pxht = \Prht\ e*^* be the polar decomposition of Pxh, and consider the low-frequency 
polynomial q(t) in Proposition 2.1 interpolating vt = e -1 ^*. We shall abuse notations and set 
Q = {%}t=o where qt = q{t/N). For t ^ T, \q(t/N)\ = \q t \ < p < 1. By construction q = P n q, and 
thus (q, h) = (q, P n h) = 0. Also, 

(P T q 1 P T h) = \\P T h\\ l . 
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The conclusion follows from 

= (q,h) = (P T q,P T h) + {P T cq,P Tc h) > \\Prh\\i - UPr^llooll^r^lll > \\P T h\\i - p\\P T M\l- 



For the numerical constant, we use Lemma 2.5 which says that if G T and 1/N < 0.1649A C , which 
is about the same as 1/SRF « 2f c /N < 2 x 0.1649 or SRF > 3.03, we have 

|g(l/JV)| < 1 - 0.3533 (f c /N) 2 « 1 - 0.0883/SRF 2 = p. 

This applies directly to any other t such that min re T \t — r\ = 1. Also, for all t at distance at least 



2 from T, Lemma 2.5 implies that \q(t/N)\ < p. This completes the proof. 



3.1 Proof of Theorem Ol 

The proof is a fairly simple consequence of Lemma 3.1 Set h = x — x and decompose the error 
into its low- and high-pass components 

h L = P n h, h H = h- h L . 



The high-frequency part is in the null space of P n and (3.1) gives 

WPrhuWi < p\\PT c h H \\i ■ 
For the low-frequency component we have 

HMl = H P «( £ - X )Hl ^ W P nX -4l + h ~ P nX\\l < 2( 5- 

To bound ||-Pt c ^_H"||i) we exploit the fact that x has minimum t\ norm. We have 

\ 1 > \\x + h\\ 1 > \\x + h H \\ 1 - \\h L \\i 

> \\x\\i - \\P T h H \\ 1 + HPt^kIIi - \\hL\\i 
>||x||i + (l-p)\\P T oh H \\ 1 -\\h L \\ 1 , 



(3.2) 



(3.3) 



x 



where the last inequality follows from (3.2). Hence, 

1 



II^Mi 



< 



\- P 



IM 



\r, II <r l+ P\\h II 

ftffi < -, \\hL\\i- 

\- p 



To conclude, 



\\h\\i < \\hL\\i + \\hH\\i < ~, \\hL\\i < 



1-P 



where the last inequality follows from (3.3). 

have 1 — p = a/SRF 2 for some numerical constant a, the upper bound 



Since from Lemma 



is 



nee from Lemma 3.1 we have 1 — p = a/SRF for some numerical c 
of the form 4a" 1 SRF 2 5. For A(T) > 2.5A C , we have a' 1 w 11.235. 
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3.2 Sparsity is not enough 



Consider the vector space C 48 of sparse signals of length N = 4096 supported on a certain interval 
of length 48. Figure 7 shows the eigenvalues of the low-pass filter P n = j^F n F* acting on C 48 for 
different values of the super-resolution factor. For SRF = 4, there exists a subspace of dimension 
24 such that any unit-normed signal (||x||2 = 1) belonging to it obeys 



\P n x\\ 2 < 2.52 10" 



-15 



43- 



1 



\F n x\\ 2 < 5.02 10" 



For SRF = 16 this is true of a subspace of dimension 36, two thirds of the total dimension. Such 
signals can be completely canceled out by perturbations of norm 5.02 10~ 8 , so that even at signal- 
to- noise ratios (SNR) of more than 145 dB, recovery is impossible by any method whatsoever. 
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(b) 



(c) 



Figure 7: (a) Eigenvalues of P n acting on signals supported on a contiguous interval of length 
48 for super-resolution factors of 2, 4, 8 and 16 and a signal length of 4096. (b) Singular values 
of ~r^F n on a logarithmic scale, (c) Same as (b) but on a linear scale. Due to limited numerical 
precision (machine precision), the smallest singular values, marked with circular dots on the 
graphs, are of course not computed accurately. 



Interestingly, the sharp transition shown in Figure [7] between the first singular values almost equal 
to one and the others, which rapidly decay to zero, can be characterized asymptotically by using 
the work of Slepian on prolate spheroidal sequences 136]. Introduce the operator Tk, which sets 
the value of an infinite sequence to zero on the complement of an interval T of length k. With the 



notation of Section |1,7[ the eigenvectors of the operator VwTk are the discrete prolate spheroidal 
sequences {sj}^ =1 introduced in 36 



VwTkSj 



AjSj, 



1 > Ai > A 2 > . . . > A fc > 0. 



(3.4) 



Set Vj = TkSj/yC\j, then by (3.4), it is not hard to see that 



TkPy/Vj 



XjVj, 



u 3\\2 



1. 
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In fact, the v/s are also orthogonal to each other 

C (which can represent any sparse vector supported on T). For values of j near k, the value of Xj 



and so they form an orthonormal basis of 
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is about 



14(fc-j)+9 2(fc-j) + l ^l.int; 



where 



2^/a 
a = 1 + cos 2ttW, 7 = log ( 1 + 



y/2-y/a. 

Therefore, for a fixed value of SRF = 1/2W, and /c > 20, the small eigenvalues are equal to zero for 



all practical purposes. In particular, for SRF = 4 and SRF = 1.05 we obtain (1.17) and (1.19) in 



Section |1.7| respectively. Additionally, a Taylor series expansion of 7 for large values of SRF yields 



( 1-200 . 

Since HT'w^jll^ = \fX~ji ^ ne bound on Xj for j near k directly implies that some sparse signals 
are essentially zeroed out, even for small super-resolution factors. However, Figure [7] suggests an 
even stronger statement: as the super-resolution factor increases not only some, but most signals 
supported on T seem to be almost completely suppressed by the low pass filtering. Slepian provides 
an asymptotic characterization for this phenomenon. Indeed, just about the first 2kW eigenvalues 
of Vy/Tk cluster near one, whereas the rest decay abruptly towards zero. To be concrete, for any 
e > and j > 2kW (1 + e), there exist positive constants Co, and 70 (depending on e and W) such 
that 

Xj < C Q e~ lok . 

This holds for all k > ko, where ko is some fixed integer. This implies that for any interval 
T of length k, there exists a subspace of signals supported on T with dimension asymptotically 
equal to (1 — 1/SRF) k, which is obliterated by the measurement process. This has two interesting 
consequences. First, even if the super-resolution factor is just barely above one, asymptotically 
there will always exist an irretrievable vector supported on T. Second, if the super-resolution 
factor is two or more, most of the information encoded in clustered sparse signals is lost. Consider 
for instance a random sparse vector x supported on T with i.i.d. entries. Its projection onto a fixed 
subspace of dimension about (1 — 1/SRF) k (corresponding to the negligible eigenvalues) contains 
most of the energy of the signal with high probability. However, this component is practically 
destroyed by low-pass filtering. Hence, super-resolving almost any tightly clustered sparse signal in 
the presence of noise is hopeless. This justifies the need for a minimum separation between nonzero 
components. 



4 Minimization via semidefinite programming 



At first sight, finding the solution to the total- variation norm problem (1.4) might seem quite 
challenging, as it requires solving an optimization problem over an infinite dimensional space. It 
is of course possible to approximate the solution by discretizing the support of the signal, but this 
could lead to an increase in complexity if the discretization step is reduced to improve precision. 
Another possibility is to try approximating the solution by estimating the support of the signal 



in an iterative fashion I5J. Here, we take a different route and show that (1.4) can be cast as 
a semidefinite program with just (n + 1) /2 variables, and that highly accurate solutions can be 
found rather easily. This formulation is similar to that in [3] which concerns a related infinite 
dimensional convex program. Our exposition is less formal here than in the rest of the paper. 
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The convex program dual to (1.4) is 



max Re(y, c) subject to 



l^cH^l; 



(4.1) 



the constraint says that the trigonometric polynomial (J-^c)(t) = J2\k\<f c Cke t27Tkt has a modulus 
uniformly bounded by 1 over the interval [0,1]. The interior of the feasible set contains the origin and 
is consequently non empty, so that strong duality holds by a generalized Slater condition 33 . The 



cost function involves a finite vector of dimension n, but the problem is still infinite dimensional 
due to the constraints. A corollary to Theorem 4.24 in [17] allows to express this constraint as 
the intersection between the cone of positive semidefinite matrices {X : X y 0} and an affine 
hyper plane. 

Corollary 4.1 A causal trigonometric polynomial Y^k=o c fc e * * with c € C n is bounded by one in 
magnitude if and only if there exists a Hermitian matrix Q G C™ xn obeying 

~Q 



to, 



EQ 



i,i+j 




,n 



1. 



(4.2) 



To see one direction, note that the positive semidefiniteness constraint is equivalent to Q — cc* ^ 0. 



Hence, z*Qz > \c*z 
(4~2J) give z*Qz = 1 and 



for all z € 

* |2 
C*Z\ = 



Fix t G [0, 1] and set Zk = e 



i2irkt 



The equality constraints in 



magnitude of the trigonometric polynomial Ylk=o c fc e * *• 



|(J r *c)(i)| so we obtain the desired inequality constraint on the 



Returning to (4.1), the polynomial e -* c (J r *c)(t) is causal and has the same magnitude as 



(J r *c)(i). Hence, the dual problem is equivalent to 

max Re(y, c) subject to 

c,Q 



(4.2). 



(4.3) 



To be complete, the decision variables are an Hermitian matrix Q £ c nxn anc | a vector of coeffi- 
cients c 6 C n . The finite dimensional semidefinite program can be solved by off-the-shelf convex 
programming software. 



The careful reader will observe that we have just shown how to compute the optimal value of ( 1.4 ) 



but not how we could obtain a solution. To find a primal solution, we abuse notation by letting c 



be the solution to (4.3) and consider the trigonometric polynomial 



P2n-2{e 



J2nt\ 



i-\{Kc)W 



2/c 

y^ ,,,/v '' 

fc=-2/ c 



i2~ k I 



Uk 



E- 



(4.4) 



Note that z 2 ^ c p2n-2(z), where z G C, is a polynomial of degree 4/ c = 2(n — 1) with the same roots 
as P2n-2(z) — besides the trivial root z = 0. Hence, P2n-2(e t2nt ) has at most 2n — 2 roots. By 
construction P2n-2{e l2rct ) is a real- valued and nonnegative trigonometric polynomial; in particular, 
it cannot have single roots on the unit circle since the existence of single roots would imply that 
P2n-2(e t27Tt ) takes on negative values. Therefore, P2n-2{& t2lTt ) is either equal to zero everywhere or 
has at most n — \ roots on the unit circle. By strong duality, any solution x to (1.4) obeys 



Re(y, c) = Re(.F n x, c) = Re(x, J 7 * c) = Re 



0F*c) (t) x(dt) 



ITV ' 
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Figure 8: The sign of a real atomic measure x is plotted in red. The trigonometric polynomial 



J-"*c where c is a solution to the dual problem ( 4.3 ) is plotted in blue. Note that F*c interpolates 
the sign of x. Here, f c = 50 so that we have n = 101 low-frequency coefficients. 



which implies that the trigonometric polynomial J-"*c is exactly equal to the sign of x when x is not 
vanishing. This is illustrated in Figure [8j Thus, to recover the support of the solution to the primal 
problem, we must simply locate the roots of P2n-2 on the unit circle, for instance by computing the 
eigenvalues of its companion matrix |31|. As shown in Table pi this scheme allows to recover the 
support with very high precision. Having obtained the estimate for the support T, the amplitudes 
of the signal can be reconstructed by solving the system of equations J2tef s~ %2vkt o-t = Uk, \k\ < f c , 
using the method of least squares. There is a unique solution as we have at most n — 1 columns 
which are linearly independent since one can add columns to form a Vandermonde systemj^igure 
[9] illustrates the accuracy of this procedure; a Matlab script reproducing this example is available 
at http : //www-stat . Stanford. edu/~candes/superres_sdp . 



.m 



fc 


25 


50 


75 


100 


Average error 


6.66 10" 9 


1.70 10" 9 


5.58 10~ 10 


2.96 10~ 10 


Maximum error 


1.83 10- 7 


8.14 10" 8 


2.55 10" 8 


2.31 10" 8 



Table 5: Numerical recovery of the support of a sparse signal obtained by solving (|4.3| via 
CVX 
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For each value of the cut-off frequency f c , 100 signals were generated with ran- 
dom complex amplitudes situated at approximately / c /4 random locations in the unit interval 
separated by at least 2// c . The table shows the errors in estimating the support locations. 



In summary, in the usual case when p2n-2 has less than n roots on the unit circle, we have explained 
how to retrieve the minimum total-variation norm solution. It remains to address the situation 
in which p2n-2 vanishes everywhere. In principle, this could happen even if a primal solution to 



4 The set of roots contains the support of a primal optimal solution; if it is a strict superset, then some amplitudes 
will vanish. 
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Figure 9: There are 21 spikes situated at arbitrary locations separated by at least 2A C and 
we observe 101 low-frequency coefficients (f c = 50). In the plot, seven of the original spikes 
(black dots) are shown along with the corresponding low resolution data (blue line) and the 
estimated signal (red line). 




Figure 10: The trigonometric polynomial Vi n -i{e aivt ) with random data y € 
and f c = 10) with i.i.d. complex Gaussian entries. The polynomial has 16 roots. 



(n = 21 
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(1.4) is an atomic measure supported on a set T obeying \T\ < n. For example, let x be a positive 
measure satisfying the conditions of Theorem |1,2[ which implies that it is the unique solution to 
(1.4). Consider a vector c £ C n such that (J-*c)(t) = 1; i. e., the trigonometric polynomial is 



constant. Then 



Re(y, c) = Re(7 7 Tl x, c) 



Re(x,J r ^c) 



ITV ' 



which shows that c is a solution to the dual (4.3) that does not carry any information about the 



support of x. Fortunately, this situation is in practice highly unusual. In fact, it does not occur as 
long as 

there exists a solution c to (4.3) obeying |(^c)(t)| < 1 for some t € [0, 1], (4-5) 



and we use interior point methods as in SDPT3 |38| to solve (4.3). (Our simulations use CVX 
which in turn calls SDPT3.) This phenomenon is explained below. At the moment, we would 



like to remark that Condition (4.5) is sufficient for the primal problem (1.4) to have a unique 



solution, and holds except in very special cases. To illustrate this, suppose y is a random vector, 
not a measurement vector corresponding to a sparse signal. In this case, we typically observe dual 
solutions as shown in Figure 10 (non- vanishing polynomials with at most n — 1 roots). To be sure, 



we have solved 400 instances of (4.3) with different values of f c and random data y. In every single 



case, condition (4.5) held so that we could construct a primal feasible solution x with a duality gap 
below 10 -8 , see Figure 11. In all instances, the support of x was constructed by determining roots 



of p2n-2( z ) at a distance at most 10 4 from the unit circle. 

Interior point methods approach solutions from the interior of the feasible set by solving a sequence 
of optimization problems in which an extra term, a scaled barrier function, is added to the cost 



function |4|. To be more precise, in our case (4.3) would become 



max Re [y*c] + t log det 

c,Q 



Q c 

c* 1 



subject to (4.2), 



(4.6) 



where t is a positive parameter that is gradually reduced towards zero in order to approach a 
solution to (4.3). Let A&, 1 < k < n, denote the eigenvalues of Q — cc*. By Schur's formula 



(Theorem 1.1 in |40j) we have 



log det 



Q c 
c* 1 



log det (Q - cc*) = 2J log Afc. 



fe=i 



Suppose condition (4.5) holds. Then Corollary 4.1 states that there exists c with the property that 
at least one eigenvalue of Q — cc* is bounded away from zero. This is the reason why in the limit 
t — > 0, (4.6) will construct a non-vanishing polynomial P2n-2 with at most n—1 roots on the unit 
circle rather than the trivial solution p2n-2 = since in the latter case, all the eigenvalues of Q — cc* 
vanish. Hence, an interior-point method can be said to solve the primal problem (1.4) provided 



(4.5) holds. 



To conclude, we have merely presented an informal discussion of a semidefinite programming ap- 
proach to the minimum-total variation problem (1.4). It is beyond the scope of this paper to 
rigorously justify this approach — for example, one would need to argue that the root finding pro- 
cedure can be made stable, at least under the conditions of our main theorem — and we leave this 
to future work along with extensions to noisy data. 
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(a) 



(1)) 




(c) 



(d) 



Figure 11: Primal feasible points x with a duality gap below 10 -8 are constructed from 
random data y sampled with i.i.d. complex Gaussian entries. A dual gap below 10~ 8 implies 
that ||x||tv — ||£||tv < 10~ 8 , where x is any primal optimal solution. (For reference, the 
optimal value ||x||tv is on the order of 10 in all cases.) Each figure plots the frequency of 
occurrence of support cardinalities out of 100 realizations. For example, in (a) we obtained a 
support size equal to 44 in 25 instances out of 100. The value of n is the same in each plot 
and is marked by a dashed red line; (a) n = 51, (b) n — 101, (c) n = 151, (d) n = 201. 
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5 Numerical experiments 

To evaluate the minimum distance needed to guarantee exact recovery by t\ minimization of any 
signal in C , for a fixed N, we propose the following heuristic scheme: 

• For a super-resolution factor SRF = N/n, we work with a partial DFT matrix F n with 
frequencies up to f c = \n/2\ . Fix a candidate minimum distance A. 

• Using a greedy algorithm, construct an adversarial support with elements separated by at least 
A by sequentially adding elements to the support. Each new element is chosen to minimize 
the condition number formed by the columns corresponding to the selected elements. 

• Take the signal x to be the singular vector corresponding to the smallest singular value of F n 
restricted to T. 

• Solve the l\ -minimization problem ( jl.lip and declare that exact recovery occurs if the nor- 
malized error is below a threshold (in our case 10~ 4 ). 

This construction of an adversarial signal was found to be better adapted to the structure of our 
measurement matrix than other methods proposed in the literature such as |14| . We used this 
scheme and a simple binary search to determine a lower bound for the minimum distance that 
guarantees exact recovery for JV = 4096, super-resolution factors of 8, 16, 32 and 64 and support 
sizes equal to 2, 5, 10, 20 and 50. The simulations were carried out in Matlab, using CVX 21 to 
solve the optimization problem. Figure [12] shows the results, which suggest that on the discrete 
grid we need at least a minimum distance equal to twice the super-resolution factor in order to 
guarantee reconstruction of the signal (red curve). Translated to the continuous setting, in which 
the signal would be supported on a grid with spacing 1/N, this implies that A > A c is a necessary 
condition for exact recovery. 



6 Discussion 

In this paper, we have developed the beginning of a mathematical theory of super-resolution. In 
particular, we have shown that we can super-resolve 'events' such as spikes, discontinuity points, 
and so on with infinite precision from just a few low- frequency samples by solving convenient convex 
programs. This holds in any dimension provided that the distance between events is proportional 
to 1/ f c = A c , where f c is the highest observed frequency; for instance, in one dimension, a sufficient 
condition is that the distance between events is at least 2A C . Furthermore, we have proved that 
when such condition holds, stable recovery is possible whereas super-resolution — by any method 
whatsoever — is in general completely hopeless whenever events are at a distance smaller than about 
Ac/2. 



6.1 Improvement 



In one dimension, Theorem 1.2 shows that a sufficient condition for perfect super-resolution is 



A(T) > 2 A c . Furthermore, the authors of this paper have a proof showing that A(T) > 1.85 A c is 
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Figure 12: Minimum distances (vertical axis) at which exact recovery by t\ minimization 
occurs for the adversarial complex sign patterns against the corresponding super-resolution 
factors. At the red curve, the minimum distance would be exactly equal to twice the super- 
resolution factor. Signal length is N — 4096. 

sufficient. This proof, however, is longer and more technical and, therefore, not presented here. In 
fact, we expect that arguments more sophisticated than those presented here would allow to lower 
this value even further. On the other hand, our numerical experiments show that we need at least 
A(T) > A c as one can otherwise find sparse signals which cannot be recovered by l\ minimization. 
Hence, the minimum separation needed for success is somewhere between A c and 1.85 A c . It would 
be interesting to know where this critical value might be. 

6.2 Extensions 

We have focused in this paper on the super-resolution of point sources, and by extension of discon- 
tinuity points in the function value, or in the derivative and so on. Clearly, there are many other 
models one could consider as well. For instance, we can imagine collecting low-frequency Fourier 
coefficients of a function 

j 

where {fj(t)} are basis functions. Again, / may have lots of high-frequency content but we are 
only able to observe the low-end of the spectrum. An interesting research question is this: suppose 
the coefficient sequence x is sparse, then under what conditions is it possible to super-resolve / and 
extrapolate its spectrum accurately? In a different direction, it would be interesting to extend our 
stability results to other noise models and error metrics. We leave this to further research. 
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A Background on the recovery of complex measures 

With T = [0, 1], the total variation of a complex measure iy on a set B G B (T) is defined by 

oo 

\u\ (B) = sup X>(£;)h 

where the supremum is taken over all partitions of B into a finite number of disjoint measurable 
subsets. The total variation \v\ is a positive measure on B (T) and can be used to define the 
total- variation norm on the space of complex measures on B (T), 

HII II /HT<\ 

VUmr = \U\ T . 



For further details, we refer the reader to [341. 

Proposition A.l Suppose that for any vector v G C' ' with unit-magnitude entries, there exists a 



low-frequency polynomial q (2.1) obeying (2.2). Then x is the unique solution to (1.4). 



Proof The proof is a variation on the well-known argument for finite signals, and we note that a 
proof for continuous-time signals, similar to that below, can be found in J9l. Let £ be a solution to 



(1.4) and set x = x + h. Consider the Lebesgue decomposition of h relative to \x\, 

h = hx + hx c , 

where (1) hx and hx^ is a unique pair of complex measures on B (T) such that hx is absolutely 
continuous with respect to |a;|, and (2) hx c and |a;| are mutually singular. It follows that hx is 
concentrated on T while hx? is concentrated on T c . Invoking a corollary of the Radon- Nykodim 
Theorem (see Theorem 6.12 in |34| ) , it is possible to perform a polar decomposition of hx'- 

h T = e i2l " m \h T \, 

such that (f) (t) is a real function defined on T. Assume that there exists q(t) = Ylj=-f Oje^ 1271 ^ 
obeying 

(q( tj )=e-^^\ Vt.GT 

\|<z(t)|<l, ViG[0,l]\T. 

The existence of q suffices to establish a valuable inequality between the total-variation norms of 
hx and /it c - Begin with 

q(t)h(dt) = I q(t)h T (dt) + [ q(t)h T c(dt) = \\h T \\ TY + / q(t)h T o(dt) 





It 

and observe that 



provided hx<^ / 0. This gives 



/(t)/i T c(di) 



< ||/lT c 



I TV 



II^tIItv - H^Htv 

with a strict inequality if h ^ 0. Assuming h ^ 0, we have 

IMItv - ll x + ^Htv = ll x + ^tIItv + II^HItv - II x IItv ~ II /i t|Itv + II^tHItv > II^IItv 

This is a contradiction and thus h = 0. In other words, x is the unique minimizer. 
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B Proof of Lemma 12.6 



The first inequality in the lemma holds due to two lower bounds on the sine function: 

|sin (vrt)| > 2 \t\ , for all t G [-1/2, 1/2] 

2t 



sin (vrt) > vrt 



7T 3 t 3 

6 



a(i) 



for all t > 0. 



(B.l) 

(B.2) 



The proof for these expressions, which we omit, is based on concavity of the sine function and on 
a Taylor expansion around the origin. Put / = / c /2 + 1 for short. Some simple calculations give 
K'(0) = and for t / 0, 



K' (t) = 4vr 



sin (fivt)\ f cos (f irt) sin (/vrt) cos (vrt) 
f sin (irt) J \ sin (irt) f sin 2 (vrt) 



(B.3) 



Further calculations show that the value of the second derivative of K at the origin is — vr 2 / c (f c + 4) /3, 
and for t 7^ 0, 



X* (*) 



4tt 2 sin 2 (/vrt) 
/ 2 sin 4 (vri) 



3 I cos (firt) 



sin (/7rt) cos (irt) 
f sin (vri) 



sin 2 (/7ri) 



sin (2/TTi) sin 2 (/vrt) sin 2 (firt) 



+ 



+ 



/tan(vrt) / 2 tan 2 (irt) f 2 sin 2 (vrt) 
It is also possible to check that the third derivative of K is zero at the origin, and for t ^ 0, 

47r 3 sin (/7rt) 



K'" (t) 



with 
Hi(t) 

m) 

H 3 (t) 



cos (firt) 
cos (/7r£) 



/sin 4 (vrt) 
sin(/7rt) cos(7rt) x " 



6H1 (t) + 9 sin (/vrt) ff 2 (t) + sin 2 (firt) H 3 (t)) 



(B.4) 



(B.5) 



/sin(vrt) 

sin (/7r£) cos (irt) 

fain (id) 

3cos(/vrt) (1 + cos 2 (irt)) 



. , . 2 cos (/7r£) sin (/vrt) sin (/7ri) 

Sm(/7rf) " /tan (vrt) + p tan 2 (vrt) + / 2 sin 2 (vrt) 



/ 2 sin 2 (vrt) 



COS (/7Tt) + 



3 sin (firt) sin (/vrt) (1 + 5 cos (vrt)) 



/ tan (vrt) 



P sin 3 (vrt) 



The remaining inequalities in the lemma are all almost direct consequences of plugging (B.l) and 



( |B,2 ) into (B.3), (B.4) and (B.5). The bounds are nonincreasing in t because the derivative of 
b(t) is negative between zero and v2/ir and one can check that f^(v2/vr) < H^° for f c > 128. 
Additionally, b k (t) is strictly convex for positive t and k E {1,2,3}, so the derivative with respect 
tor of b k (A-T) + b k (A + r) is positive for < r < A/2, which implies that B £ (A-t) + Be(A + r) 
is increasing in r. 
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C Proof of Theorem 11.3 



Theorem 1.3 follows from Proposition |C.l below, which guarantees the existence of a dual certificate. 



In this section, we write A = A(T) > A m j n = 2.38 A c . Unless specified otherwise, \r — r'\ is the oo 
distance. 

Proposition C.l Let T = {n,r2, ■ ■ •} C T 2 be any family of points obeying the minimum distance 
condition 

\tj - r k \ > 2.38 A c , Tj ^ r k eT. 

Assume f c > 512. Then for any vector v G W ' with \vj\ = 1, there exists a trigonometric 
polynomial q with Fourier series coefficients supported on {— f c , —f c + 1, . . . , f c } 2 with the property 



q(rj) = Vj, tj G T. 

\q(r)\<l, fGT 2 \T. 



(CI) 



The proof is similar to that of Proposition |2.1| in that we shall construct the dual polynomial q by 
interpolation with a low-pass, yet rapidly decaying two-dimensional kernel. Here, we consider 



K zu (r) =K{x)K (y) 



obtained by tensorizing the square of the Fejer kernel (2.3). (For reference, if we had data in which 
y(k) is observed if ||fe||2 < fc, we would probably use a radial kernel.) Just as before, we have fixed 
K somewhat arbitrarily, and it would probably be possible to optimize this choice to improve the 
constant factor in the expression for the minimum distance. We interpolate the sign pattern using 
K and its partial derivatives, denoted by Kfi \ and K?P U respectively, as follows: 

9 (0 = E K'^ 2D ( r " r ^ + ^ K th0) (r ~ rj) + /3 2 ^ ( 2 D 1) (r - rj)] , 
and we fit the coefficients so that for all tj G T, 



q(tj) =Vj, 
Vq(t J )=0. 



(C.2) 



The first intermediate result shows that the dual polynomial is well defined, and also controls the 
magnitude of the interpolation coefficients. 



Lemma C.2 Under the hypotheses of Proposition C.l, there are vectors a, j3\ and fii obeying 



(C.2} and 

2 



., , (C3) 



llalL < 1 + 5.577 10 
H/311^ < 2.930 10- 2 A C , 

where /3 = (/Si,/^)- Further, if v± = 1, 

ai > 1-5.577 10~ 2 . (C.4) 
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Proposition C.l is now a consequence of the two lemmas below which control the size of q near a 



point ro G T. Without loss of generality, we can take ro = 0. 



Lemma C.3 Assume G T. Then under the hypotheses of Proposition C.l, \q(r)\ < 1 for all 
0< It-I < 0.2447 X.. 



Lemma C.4 Assume G T. Then under the conditions of Proposition C.l, \q(r)\ < 1 for all r 
obeying 0.2447 A c < \r\ < A/2. This also holds for all r that are closer to G T (in the oo distance) 
than to any other element in T . 



C.l Proof of Lemma 1021 

To express the interpolation constraints in matrix form, define 



(D ) ik = K™( rj -r k ) 



(%,o)), fe = ^(to) fa - r k ) , (D (0>1) ) = ^ fa - r fe ) , 



(^(i,i)) ifc = ^(i D i) fa " r fc ) , (^(2,o)) ife = ^( 2 D o) fa " **) > (^(o,2)) ifc = ^(o D 2) fa " r*) • 

To be clear, K?P # -, means that we are taking ^i and £2 derivatives with respect to the first and 
second variables. Note that Do, -D(2,o)> -0(i,i) an d Ao,2) are symmetric, while -D(i,o) and -D(o,i) 
are antisymmetric, because K and K" are even while K' is odd. The interpolation coefficients are 
solutions to 



D a 



D(i,o) -O(o,i) 



-0(1,0) -^(2,0) -0(1,1) 
-O(o,i) -0(i,i) -O(o,2) 





a 




V 






Pi 


= 





O 




A 










£f 



£>0 

£l #2 



(C.5) 



where we have defined two new matrices D\ and D2 ■ The norm of these matrices can be bounded 
by leveraging ID results. For instance, consider 



ij-a.il = E !^ 2D fa)l- 

rj eT\{o} 



We split this sum into different regions corresponding to whether \xj\ or \yj\ < A/2 and to 
min(|xj|, \yj\) > A/2. First, 



E 

r^0:| % |<A/2 



K 2D fr f - 



< E So(x J )<2E^o(jA). 

r^0:|jy|<A/2 j>l 



This holds because the Xj's must be at least A apart, Bq is nonincreasing and the absolute value 
of K 2T> is bounded by one. The region {rj 7^ 0, \xj\ < A/2} yields the same bound. Now observe 
that Lemma C.5 below combined with Lemma 2.6 gives 



E 

rjj^O : m\n(x j ,yj)> A/2 



K 2D (r,)|< 



E B ( Xj )B (y J )<[Y,B (A/2 + j 1 A) 

rjj^0:mm(xj,yj)>A/2 ji>0 
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To bound this expression, we apply the exact same technique as for (2.11) in Section 2.3 starting 
at j = and setting jo = 20. This gives 



|/- J Do|| 00 <4^B (iA) + 4[^Bo(A/2 + jA) 



< 4.854 1(T Z . 



(C.6) 



i>i 



i>o 



Lemma C.5 Suppose x € K+ and f(x) = /i(^i)/2(a?2) where both f\ and fi are nonincreasing. 
Consider any collection of points {xj} C M+ for which \x{ — Xj\ > 1. Then 

£/(*,) <X>(ji)X>(i 2 ). 

i ii>o j 2 >o 

Proof Consider the mapping x G M+ t— > (L^iji L x 2j)- This mapping is injective over our family 
of points. (Indeed, two points cannot be mapped to the same pair of integers (ji, j'2) as it would 
otherwise imply that they are both inside the square [j'i + 1) x [j 2 + l), hence violating the separation 
condition.) Therefore, the monotonicity assumption gives 

j j jl,J2>0 

which proves the claim. ■ 

Applying the same reasoning, we obtain 

ll%,o)|| 00 <2^i?i(jA) + 2||K / || 00 ^i? (jA) + 4[^i?o(A/2 + jA)][^S 1 (A/2 + iA)' 
i>i i>i i>o i>o 

In turn, the same upper-bounding technique yields 

||£>(i,o)|L < 7.723 HT 2 / C , (C7) 

where we have used the fact that [| JFsT'Hoc, < 2.08 (/ c + 2), which follows from combining Lemma 



2.6 



with (2.21). Likewise, 

||% il) || oo <4||^'|| 00 ^B 1 (iA) + 4[^i? 1 (A/2 + jA)' 



< 0.1576/ c 2 , 



(C.8) 



i>i 



i>o 



and finally, 



*£» (0) 



I- D 



(2,0) 



<2^ J B 2 (iA) + 2||K"|| 00 ^i?o(iA) 



i>i 



i>i 



4[^S (A/2 + iA)][^B 2 (A/2 + iA)] < 0.3539 / 6 2 , (C.9) 



i>o 



j>o 



since [lif'Hoo = 7r 2 / c (/ c + 4) /3, as \K"\ reaches its global maximum at the origin. 
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We use these estimates to show that the system (C.5) is invertible and to show that the coefficient 
sequences are bounded. To ease notation, set 



S 1 = D 



(2,0) 



D (l,l) D (0,2) D (l,V> 



'(1,0) - ^(1,1)^(0,2)^2/' 

S3 = A) + S 2 S{ 5 2 - Z?( ,i)-D^ )2 ^(o,i)- 



Note that Si is a Schur complement of -D(o,2) an d that a standard linear algebra identity gives 



D. 



-1 



1-1 



Si ~ S l -°(1, 1)^(0,2) 

~ D ~{0,2) D (l,l) S l l D {Q,2) + D (0,2) D (^) S 1 D (^) D (0 l ,2). 



Using this and taking the Schur complement of D 2 , which is equal to S3, the solution to (C.5) can 
be written as 



I 

-D 2 l Di 



d + b\b 2 x bi 



V 44> 



a 

Pi 

02 



I 

i-l 



—Si S 2 

l/ 5 ^) (^(l,!) 5 ! 1 ^ - £>(0,1)) 



s^v. 



Applying (2.13) from Section 2.3.1, we obtain 



D- 1 

(0,2) 



< 



l (0,2) 



Kf,\ (0) - K?» (0) 



^(0,2) 



I-D 



(0,2) 



< 



0.3399 



/< 



(CIO) 



which together with Kf 2 \ (0) = -ir 2 f c (/c + 4) /3 and dCjj|) imply 



'(2,0) 



iT, 



2D 

(2,0) 



(0) 



i-s l 



< 



K, 



2D 

(2,0) 



(0) 



I-D 



(2,0) 



+ 11^(1,1)1 



D 



Another application of (2.13) then yields 

lis 1 - 1 1 1 < 

II J- Moo — 



'(2,0) 



*Sn (0) - K?» (0) 



k (2,0) 



/-Si 



< 



(0,2) 



0.3408 



< 0.33624 f c . 



fl 



(C.ll) 



Next, dC?f| >, d08| ) and ( |Cl0| > allow to bound S 2 , 



II^Hoo <||£»(1,0)|L + ||%,1)| 



D 



(0,2) 



D 



(0,1)1 



< 8.142 10~ 2 /c 



which combined with flC.6[ ), ( |C.7| |, flC.10[ ) and (|C_llj) implies 

Isr 1 !! +11-° 

I 1 Moo ' 



IZ-^lloo^llZ-^olloo + ll^ll^ 



(0,1) 



D 



(0,2) 



< 5.283 10" 



The results above allow us to derive bounds on the coefficient vectors by applying (2.13) one last 
time, establishing 



-11 

7-1. 



Jilloo < H^i '^s^lL - H^ilLII 52 '^ 



~ UI l|52|L||S'7 1 || < 2.930 10~ 2 A C 

M M '"Mil J IIOO — c 

II 



C~ 1 II T CM 

O* II. IU — ^3| loo 



a 1 = Wl -((/-^ 1 ) W ) 1 >l- |r3 lx 
where the last lower bound holds if v 1 = 1. The derivation for 



> 1- 5.577 10~ z , 

„ is identical and we omit it. 
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C.2 Proof of Lemma l03l 



Since v is real valued, a, j3 and q are all real valued. For \r\ < 0.2447 A c , we show that the Hessian 
matrix of q, 

H = Q(2,o) (r) 9(i,i) ( r ) 
|?(l,i) ( r ) 9(o,2) (r) 

is negative definite. In what follows, it will also be useful to establish bounds on the kernel and its 
derivatives near the origin. Using (2.20[)-(2.24), we obtain 



K zu (x,y)> 1 



Kfg 0) (x,y)< 



7T 2 / C ifc + 4) x- 
6 



1 



7T 2 /c(/c + 4)r 



G 



vr 2 / c (/ c + 4) , (/ c + 2) 4 vr 4 x 



4 ^4^,2 



+ 



6 



7r 2 /c(/c + 4)j/ s 
6 



and 



Kf? n Ax,y) 



L (i,o) 



K, 



2D 

(2,1) 



(a?,y) 



< 



< 



vr 2 / c (/ c 


+ 4:) X 


3 

^r 4 / 2 (/c 


+ 4) 2 y 



9 



K$ x) {x,V) 



K, 



2D 
(3,0) 



(z,2/) 



< 



< 



^ftUc + ^Yxy 
9 

vr 4 (/ c + 2) 4 x 



These bounds are all monotone in x and y so we can evaluate them at x = 0.2447 A c and y 
0.2447 A c to show that for any \r\ < 0.2447 A c , 



K lu (r) > 0.8113 



^(i d d v 



< 0.6531 f c , 



K(m (r) 
*( 2 °U (r) 



< 0.8113 



< 2.669 fl 



K$ fl) {r)<-2.m7fi, 



K, 



2D 

(3,0) 



(r) 



< 8.070 / c 3 . 



(C.12) 



The bounds for K?® 0) , K?® K 2 2 D 1} and Kf® 0) of course also hold for K?^, K?® 2) , K?® 2) and 



'(3,0) 



(0,1)' v (0,2)> JV (1,2) 



*£&)(' -»* 



K 2 3 y Additionally, it will be necessary to bound sums of the form X)r-eT/{o> 
for r such that |r| < A/2 and 4,4 = 0,1,2,3. Consider the case (4,4) = (0,0). Without loss 
of generality, let r = (x,y) G M^_. By Lemma C.5, the contribution of those rj's belonging to the 
three quadrants {\r\ > A/2} \ M+ obeys 

J2 \K 2D (r - rj )\ < 3[£B (A/2 + jA) 

\r i \>A/2,r j 0L 2 + j>0 

Similarly, the contribution from the bands where either \rji\ or \rj2\ < A/2 obeys 



\ rj ,i\< A/2 or \r ji2 \< A/2 



<2^5 (jA 

i>i 



It remains to bound the sum over rj's lying in the positive quadrant {\r\ > A/2} nM^. To do this, 



let /i (t) be equal to one if \t\ < A and to Bo(At — \r\) otherwise. Taking fi = /i, Lemma C.5 gives 
£ ^^(r-r.Ol^E^aA-lrD+^SoO-A-lr '' 



|r,-|>A/2,r.,- 



i>i 



i>i 
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We can apply exactly the same reasoning to the summation of K?P „ , for other values of £\ and 
£2, and obtain that for any r such that \r\ < A/2, 



E \ K fiA)(r- r i) <%a)(M); 



rj6T\{0} 



(C.13) 



here, for u > 0, 



J (^i,fe) 



n 



2 ^ K^ 2 (j A - u) + 2tf£ a >5< 1 (jA - u) + Kg* J2 B ^ V A ) 

+ #<£> £ 5 €l (j A) + 3 [J] B* (A/2 + j A)] [£ B, a (A/2 + jA 
i>i i>o 

+ [^)S /l (jA-u)][X;^ a 0-A)" 



j>o 



3>1 



i>i 



in which -fQo is a bound on the global maximum of K^ 1 '. The absolute value of the kernel 
K and its second derivative reach their global maxima at the origin, so Kso = 1 and Kso = 



n fc (fc + 4) /3. Combining the bounds on \K'\ and \K'"\ in Lemma 2.6 with (2.21) and (2.24), we 



can show that K& = 2.08 (f c + 2) and i^ } = 25.3 (/ c + 2) 3 if f c > 512. Since Z^ lth) = Z {hA) , 
we shall replace Zi^^) for which £1 > £2 by Z(i^ x \. 

Since 

9(2,0) (r) = £ a^ ( 2 2 D ) (r - r 3 ) + ^Kf fi) (r - Tj ) + /%K 2 2 D 1} (r - rj ) 



,eT 



it follows from flC~T2] ) and ( [0131 ) that 



g (2 , ) (r) < ai-ffgjj) (r) + | |a| U ]T |# ( 2 2 D 0) (r - r,) 

r,-6T\{0} 



+ 11011c 



^(3 D o) W 



+ E *§3» (r - *-i) + ^ 2 D i) (r) + E ^mir-rj) 

r 3 eT\{0} r,eT\{0} 

< ai Kfg 0) (r) + IHU Z (0j2) (|r|) + H/3IL (|^f 3 D 0) (r)| + Z (0j3) (|r|) + ^f^ (r)| + Z (lf2) (|r 
< -1.175/1. 



The last inequality uses values of Z^ u ^ (u) at u = 0.2447 A c reported in Table pi By symmetry, 
the same bound holds for <7(o,2)- Finally, similar computations yield 



|9(M)< 



E a i K f,D ( r " r i) + ^ K (2 D D ( r " r i) + ^S (r - rj) 



,eT 



: a 



[|jsgf x) (r)| +%i)(|r|) 



+ 



-2D 



*& W 



*& (r) 



+ 2Z (1>2) (|r| 



< 1-059 /« 



Since Tr(i7) = ^(2,0) + 9(0,2) < and det(H) = |<Z(2,o)lk(o,2)l ~~ k(i,i)| 2 > 0, both eigenvalues of H 
are strictly negative. 



46 



z (o,o)(u) 



Z(o,i)(u) 2(i,i) (u) 



2(0,2) («) 



2(1,2) (u) 2(0,3) (n) 



6.405 10" 



0.1047 f c 0.1642/ c 2 



0.4019 f c 



0.6751 / c 3 1.574/ c 3 



Table 6: Upper bounds on Z(^ 2 )(u) at 0.2447 A c 



We have shown that g decreases along any segment originating at 0. To complete the proof, we 
must establish that q > — 1 in the square. Similar computations show 

Q (r) = E a i K ™ ( r " r i) + ^^(i D o) ( r " r i) + &i*?&) (r - r 5 ) 



-2D 



>aitf^(r)HMIoo-Z(o,o)(M) 
> 0.6447. 



*<fti) W 



+ 



Kff 0) (r) +2Z (0 ,i)(|r|) 



C.3 Proof of Lemma IC.4I 

For 0.2447 A c < \r\ < A/2, 



kl < 



E 



Q: ; 



-2D 



2D 



■.jK™ (r - rj) + frjKfi 0) (r - r 3 ) + fcKfty (r - rj ) 



< Hal 



[I 



K^ (r)\ + Z m (\r\) +H/3H 



K m (r) 



+ 



K m <r) 



+ 22 (0i i)(|r|) 



Using the series expansion around the origin of K and K' (2.29), we obtain that for t\ < \r\ < £2, 

vr 2 /c(/ c + 4)x 2 , 7r 4 (/ c + 2) 4 *^ 



\K 2D (r)\< 1 



< 1 



+ 



72 



1 7T 2 / c (/c + 4)y 2 | 7T 4 (/ C + 2)V 



6 



72 



7r 2 fi ++ri 2 



2 



12 



z^2D 
A (l,0) 



(r) 



< 



V/ c (/ c + 4)t 2 



The same bound holds for K?^^. Now set 



W(r) = a°° \K IU {r) +2/3 



A' 



2D 
(1.0) 



(r) 



where a°° and /3°° are the upper bounds from Lemma C.2| The quantities reported in Table [7] imply 
that setting {h,t 2 } to {0.1649 A c , 0.27 A c }, {0.27 A c , 0.36 A c }, {0.36 A c , 0.56 A c } and {0.56 A c , 0.84 A c } 
yields \q\ < 0.9958, \q\ < 0.9929, \q\ < 0.9617 and \q\ < 0.9841 respectively in the corresponding 



intervals. Finally, for \r\ between 0.84 A c and A/2, applying Lemma (2.6) yields W (r) < 0.5619 



Z (0) o) (0.84 A c ) < 0.3646 and Z (0 ,i) (0.84 A c ) < 0.6502 f c , so that \q\ < 0.9850. These last bounds 
also apply to any location beyond A/2 closer to than to any other element of T because of the 
monotonicity of Bq and B\ . This concludes the proof. 
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tl/Xc 


t 2 /\c 


Upper bound on W (r) 


z {o,Q) {h) 


2(0,1) (*2) 


0.2447 


0.27 


0.9203 


6.561 10~ 2 


0.1074 


0.27 


0.36 


0.9099 


7.19610- 2 


0.1184 


0.36 


0.56 


0.8551 


9.239 10- 2 


0.1540 


0.56 


0.84 


0.8118 


0.1490 


0.2547 



Table 7: Numerical quantities used to bound \q\ between 0.2447 and 0.84. 
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